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VALIDATION OF ASVAB-2 AGAINST CIVILIAN 
VOCATIONAL-TECHNICAL HIGH SCHOOL CRITERIA 



I. INTRODUCTION 

Several years ago, the need for a common test battery for the services 
gained considerable attention In connection with the testing of high school 
seniors as part of the recruiting programs of the Army, Navy, Marine Corps^ 
and Air Force. Since 1958, the Air Force had been administering the Airman 
Qualifying Examination \AQE) In a large number of liigh schools throughout 
the country. Test scores were made available to school counselors for use 
In student vocational guidance as well as to Air Force recruiters. As the 
Air Force's testing program began receiving more and more recognition, the 
Army and Navy sought to test in the high schools--each with its own test 
battery. Subsequently, the additional testing time required cau: ed 
considerable school resistance. If testing in the high schools for recruiting 
purposes by all the services were to survive, the number of tests would have 
to be reduced. 

In early 1966, the Assistant Secretary of Defense for Manpower and 
Reserve Affairs directed the military services to explore the feasibility 
of creating a common aptitude test batteiy which would serve the following 
purposes: 

1. Stimulate Interest in military service. 

2. Provide counselor and student information on vocational aptitudes. 

3. Provide services with information on enlistment prospects. 

4. Establish mental qualifications for enlistment and induction. 

5. Identify enlistment applicants for particular occupational or 
training systems. 

6. Classification and assignment of personnel. 

A working group consisting of personnel test experts from all of the 
military services was set up to study feasibility of such a test battery 
and to develop a prototype. The Armed Services Vocational Aptitude Battery 
(ASVAB) was developed from this effort. 

Test and measurement personnel from the Army Research Institute, ihe 
Air Force Hiiman Resources Laboratory, and the Navy Personnel Research and 
Development Center directed the development of the test battery toward 
the following: 

1. Identifying Interchangeable tests within the existing service 
classification batteries. 
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2. Developing tests for the joint battery from the pool of test items 
in the interchangeable components of the existing service batteries, and 

3, Standardization of the resultant battery. 

To establish interchangeability , all of the service classification 
batteries were administered to a joint sample made up of 1200 basic trainees 
each from the Army, Navy, and Air Force; and 300 trainees from the Marina 
Corps. For all 3900 subjects, testing was arranged for three separate days 
with one of the service batteries being administered on a given day. 
Moreover, the order of battery administration was counterbalanced to eliminate 
effect of test practice; i.e., each battery was administered first to about 
one- third of the subjects, second to about one- third, etc. From this total 
sample, a smaller sample stratified to represent a full range of ability 
was selected. This selection of a representative sample was necessary 
because of the effects of selection on the service trainee population. 

From this representative sample, inter correlations among all of the 
tests in the various service classification batteries were established. 
This resulted in identification of seven content areas which were 
interchangeable and two others which were needed to augment them. On 
the basis of these analyses, nine subtests were selected for inclusion 
in the Armed Services Vocational Aptitude Battery; 

1. Coding Speed (CS) - Evaluates the examinee's ability to quickly and 
accurately assign coded numbers by relating them to specific words. It 

is designed to test clerical aptitude. 

2. Word Knowledge (WK) - A test of verbal ability involving the 
definition of words. This is a classical vocabulary test involving non- 
technical terms. 

3. Arithmetic Reasoning (AR) - Evaluates the examinee's ability to think 
through mathematical problems presented in verbal form. It involves the 
discovery and application of the general mathematical principles required 

to arrive at a correct solution to each problem as ;^ell as performance of 
the necessary calculations to attain the solutions. 

4. Tool Knowledge (TK) - A piucorial test vhich requires the examinee 
to identify pictured tools and determine related items r^th which they are 
used. 

5. Space Perception (SP) - Involves visualizing the folding of flat 
patterns into three-dimensional objects. 

6. Mechanical Comprehension (MC) - Evaluates the ability of the 
examinee to determine the operating characteristics of mechanical devices. 
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7, Shop Information (SI) - Determines the examinee's previous knowledge 
about shop practices and the use of tools in specific situations. 

8, Automotive Information (AI) - Designed to evaluate general knowledge 
about automobiles and automobile engines, 

9, Electronics Information (EI) - Involves the ability to apply previou 
acquired knowledge in the areas of electricity and electronics toward the 
solution of problems in prr ^.tical situations. 

With the exception of the Coding Speed test which has 100 items, each 
of the ASVAB subtests contain 25 items. 

The following are the five composites or aptitude areas (each formed 
by the linear combination of the subtests appropriate to the aptitude area) 
which are reported to the school counselor: 

1 • General-Technical 

2. General Mechanical 

3, Motor Mechanical 

4, Clerical 

5. Electronics 

Both the composites and the nine individual test scores are reported 
in percentile metric. Each of the services presently has its ox^ unique 
set of composites which are used for classification purposes, and these 
are computed and reported to the services only. 

The essential purpose of the study presented in this technical 
report was to develop information on the relationship between performance 
of high school students on the subtests and composites of the ASVAB-2 
and their subsequent performance in civilian vocational curricula, and 
to investigate the adequacy of the composites for school vocational 
training counseling. 

II. METHOD OF VALIDATION 

The sample used in this study consisted of a total of approximately 
4,300 high school students located primarily in the northeastern sector 
of the country. Each of the students was enrolled in one of the 41 high 
school vocational-technical courses listed in Table A2 (appendix) . 

Each of the students had been administered ASVAB-2 during the 1973-74 
school year and with the permission of the high schools participating in 
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the study, the Amed Services were provided the final grade for the specific 
vocational- technical course in which the students were enrolled. This 
information was collated with the students' ASVAB scores and the sample 
was divided into 41 subsamples. The validity of each subtest against 
each of the vocational- technical categories was established, and, through 
the use of multiple regression techniques (Ward & Jennings, 1973), multiple 
correlation of ASVAB scores and final vo-tech grade was also computed for 
each of the selected vo-tech categories. 

III. RESULTS AND DISCUSSION 

Table Al of the appendix presents the means and standard deviations 
of the ASVAB subtests and final course grade for each of the vo-tech 
categories (collapsed across schools^ , Table A2 of the appendix reports 
the means and standard deviations of the ASVAB subtests and composites 
based upon a nationwide sample of 771,031 high school students. 

A comparison of Table Al with Table A2 indicates that some kind of 
selection process has been operating regarding the selection of the 
students into the vo-tech categories. For nearly every vo-tech category, 
the mean scores on the appropriate ASVAB subtests were substantially 
higher in the validation samples than for the general high school 
potjulation. A typical example is that of the Auto Service vo-tech 
category for which the appropriate ASVAB subtests are Automotive Information 
and Mechanical Comprehension. The mean scores on each of these two tests 
in the validation sample were 16.84 and 13.58 respectively, whereas the 
mean scores for the general high school population were 11.48 and 12.51. 
Whether the restriction in range of abilities is due to self -selection, 
prerequisite training, or some other factor, we cannot be sure. 

Table A3 (appendix) presents ASVAB subtest multiple correlations against 
vo-tech grades based upon the optimum weighting of all nine of the ASVAB 
subtests, the beta or standardized weights associated with each subtest, 
and the correlation of each subtest with the criterion. Each of the vo-tech 
categories was grouped according to aptitude composite. Of the 41 vo-tech 
categories included in the study, 20 obtained multiple correlation 
coefficients which were statistically significant beyond the .01 level; 
5 were significant beyond the .05 level; and 16 were not statistically 
significant. In a previous ASVAB validation study involving the prediction 
of success in Air Force technical schools (Vitola, Mullins, & Croll, 1973), 
the predictive efficiency of the ASVAB was greater for all vo-tech 
categories. It is possible that a prinary contributing factor in this 
difference in predictive efficiency lies both in the smaller N»s used 
here and in the quality of the criterion data. Within the Air Force's 
Air Training Command, relative uniformity in the evaluation procedures 
exists within technical schools. In validating against civilian school 
criteria, a great deal of criterion heterogeneity is encountered because 
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several different vocational school systems are represented in the 
samples. 

Table A4 of the appendix presents the multiple correlation coefficients 
based upon the optimum weighting of all nine of the ASVAB subtests, the 
beta (standardized) weights associated with each subtest, and the validity 
of each subtest against vo-tech grades (within category), with a further 
breakout by specific school. Thus, while the N's are generally quite small, 
these data remove the problem of criterion heterogeneity. From a comparison 
of Tables A3 and A4, it is apparent that the multiple correlations are 
considerably higher within each school. 

Table 1 presents the average criterion correlation within schools for 
each ASVAB subtest for four broad aptitude clusters. Overall, Air Force 
aptitude composites appear to be appropriate when applied to the civilian 
training criterion as evidenced by the validity pattern in Table 1. This 
is particularly evident with the subtests forming the Mechanical and 
General aptitude areas, for each of the subtests included in each composite 
demonstrated greater validity than the other subtests. At first glance, it 
would appear that the Administrative composite should consist of Word 
Knowledge and Arithmetic Reasoning, but as this aptitude area was represented 
by only two vocational categories, additional investigation of other vo-tech 
categories within this aptitude area would be required before the current 
inclusion of Coding Speed can be considered inappropriate. Construction of 
the Electronics composite appears suitable though higher validities were 
reported for Mechanical Comprehension and Shop Information than either 
Arithmetic Reasoning or Space Perception. 



Table 1. Average ASVAB Subtest Validities Within School 



Aptitude Area 


CS 


WK 


AR 


TK 


SP 


MC 


SI 


AX 


EI 


Admin is t ra t i ve 


.18 


.34 


.34 


-.07 


.12 


.18 ■ 


-.01 


.01 


.06 


Electronics 


.21 


.16 


.23 


.25 


.26 


.30 


.35 


.24 


.37 


Mechanical 


.15 


.16 


.22 


.30 


.24 


.27 


.26 


.26 


.25 


General 


.28 


.32 


.32 


.12 


.31 


,29 


.18 


.15 


.24 



For each vo-tech category. Table A5 (appendix) compares the predictive 
efficiency of the optimally weighted full ASVAB versus the appropriate 
** selector'* composite alone. F-values are reported as well as the probabilit 
of obtaining each F-value through chance variation. The subtests which 



comprise each selector composite are identified at the bottom of the 
table. Though the squared niultiple correlations associated with many of 
the reduced models are rather low, this can be partly attributed to the 
unreliability of the criterion data in view of the fact that vddespread 
differences exist in the quality of the facilities and the instruction 
among the vocational- technical schools. Thus, condensing several different 
schools within each of the vo-tech categories markedly increases the chance 
for error in predicting course grades. 

With the vo-tech categories included in the Clerical, Electronics, 
General-Technical, and Motor Mechanical rptitude areas, the data indicates 
that for vocational and guidance counseling purposes, the ASVAB's 
utility is on par with the commercial aptitude batteries such as the 
General Aptitude Test Battery (rATB) . Data representing the predictive 
validity of the ASVAB are generally more favorable than those typically 
reflected in research studies reported with the use of the GATB 
(U.S. Department of Labor, 1970). 



12 

10 



References 



U.S. Department of Labor, Manpower Administration. Section III, 
Development. U.S. Government Printing Office, 1970. 

Vitola, B. , Mullins, C, & Cross, P. Validity of Armed Services 

Vocational Aptitude Battery^ Form 1, to Predict Technical School 
Success . AFIlRL-TR-73-7, Lackland AFB, TX: Personnel Research 
Division, Air Force Human Resources Laboratory, July 1973. AE)-767 578. 

Ward, J. H., Jr., & Jennings, E. Introduction to linear models . 
Englewood Cliffs, New Jersey: Prentice-Hall, 1973. 



O 

11 



APPENDIX A: STATISTICAL TABLES 
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Table A2* Means and Standard Deviations cf ASVAB Scores 
Nationwide Sample for School ^ear 73-74 (N = 771,031) 



ASVAB 



Standard 



Subtest Mean Deviations 

Coding Speed (CS) 48.55 14,04 

Word Knowledge (WK) 13.78 4^99 

Arithmetic Reasoning (AR) 13.29 5,85 

Tool Knowledge (TK) 10.98 6.17 

Space Perception (SP) 13.45 5,69 

Mechanical Comprehension (MC) 12,51 5,05 

Shop Information (SI) 11.60 5.48 

Automotive Information (AI) 11.48 5.20 

Electronics Information (EI) 11. lo 5,68 

ASVAB Composite 

Electronics = MC + 2EI 35.44 14.29 

General Mechanical = SP + 2SI 36.91 13.89 

Motor Mechanical = MC -f 2AI 35.79 13.28 

Clerical = WK + CS/3 29.74 7.65 

General Technical = WK + AR 27.33 9.28 
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Table A5. Full and Restricted Model RSQ's, F-Values , 
and Probability Levels 

Vo-Tech RSQ Full RSQ Restricted Selector 
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Difference significant at .05 level 



** Difference significant at .01 level 
NS Difference not significant 

Current ASVAB Composites 

General Technical (GT) = AR + WK 
Clerical (CL) = WK + 1/3 CS 
General Mechanical (GM) = SP + 2SI 
Electronics (EL) = MC + 2EI 
Motor Mechanical (MM) « MC + 2AI 
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